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1.  Introduction.  Let  X  denote  a  random  variable  having  density  function 

f(x\6)  =  a(x)/A(d ),  9  <  x  <  b  <  oo,  (1.1) 

where  a(x )  is  a  positive,  continuous  function  on  (0,6),  A{6)  =  fjj  a(x)dx  <  oo  for  every 
Q  >  0,  9  is  the  parameter,  which  is  distributed  according  to  an  unknown  prior  distribution  G 
on  (0, 6).  Two  typical  examples  of  (1.1)  are:  (I)  the  exponential  distribution  with  a  location 
parameter:  f(x\6)  =  e~(x_0),  x  >  9,  and  (II)  the  Pareto  distribution:  f(x\6)  =  a9a/xa+1, 
x  >  9. 

We  consider  the  problem  of  testing  the  hypotheses  Ho  :  9  <  9q  versus  Hi  :  6  >  60,  where 
6q  is  known  and  0  <  6q  <  6.  The  loss  function  is  1(9, 0)  —  m ax {6  —  9q,  0 }  for  accepting  Ho 
and  1(9, 1)  =  max{0o  -  #,0}  for  accepting  Hx.  A  test  S(x)  is  defined  to  be  a  measurable 
mapping  from  (0,oo)  into  [0,1]  so  that  S(x)  =  P{  accepting  Hi\X  =  rc},  i.e.,  S(x)  is  the 
probability  of  accepting  Hi  when  X  =  x  is  observed.  Let  R(G,  S)  denote  the  Bayes  risk  of 
the  test  6  when  G  is  the  prior  distribution.  Given  that  9dG(9 )  <  oo,  ai  Bayes  test  Sq  is 
found  as 

SG(x)  =  1  if  E[9\X  =  x}>  9o\  SG(x)  =  0  if  E[9\X  =  x]  <  90.  (1.2) 

Because  E[9\X  =  x]  involves  G,  the  above  solution  works  only  if  the  prior  G  is  given.  If  G  is 
unknown,  this  testing  problem  is  formed  as  a  compound  decision  problem  and  the  empirical 
Bayes  approach  is  used.  Let  Xi,X2,  ■  ■  • ,  Xn  be  the  observations  from  n  independent  past 
experiences.  Based  on  Xn  =  (Xi,  X2,  •  •  • ,  Xn)  and  X,  an  empirical  Bayes  rule  Sn(X,Xn) 
can  be  constructed.  The  performance  of  8n  is  measured  by  R(G,8n )  -  R(G,8g)>  where 
R(G,6n )  =  E[R(G,5n\Xn)}.  The  quantity  R(G,5n)  -  R(G,8g )  is  referred  as  the  regret 
Bayes  risk  (or  regret)  in  the  literature. 

This  empirical  Bayes  approach  was  introduced  by  Robbins  (1956,  1964).  Since  then, 
it  has  been  widely  used  in  statistics.  For  the  family  (1-1),  some  problems  of  statistical 
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inference  based  on  the  empirical  Bayes  method  have  been  considered  by  Prasad  and  Singh 
(1990),  Liang  (1993),  Datta  (1994),  Huang  (1995),  Balakrishnan  and  Ma  (1997),  Huang  and 
Liang  (1997),  Ma  and  Balakrishnan  (2000),  among  others.  In  this  paper,  we  consider  the 
testing  problem  and  study  the  empirical  Bayes  tests  for  the  family  (1.1).  The  optimal  rate 
of  convergence  of  monotone  empirical  Bayes  tests  is  obtained  and  a  test  with  the  optimal 
rate  is  constructed. 

The  paper  is  organized  as  follows.  In  Section  2  we  provide  a  few  preliminary  results.  In 
Section  3  we  construct  a  monotone  empirical  Bayes  test  Sn  and  obtain  an  upper  bound  of  its 
regret.  In  Section  4,  a  minimax  lower  bound  of  the  regrets  of  monotone  empirical  Bayes  tests 
is  obtained.  Since  the  rates  in  the  upper  bound  of  Section  3  and  lower  bound  of  Section  4 
coincide,  the  optimal  rate  is  identified.  As  a  byproduct,  we  see  that  Sn  achieves  the  optimal 
rate  of  convergence.  The  proofs  of  main  results  in  Section  3  and  4  are  given  in  Section  5. 

2.  Preliminary.  We  assume  that  P(6  >  60)  ■  Pie  <  6Q)  >  0  in  this  paper.  If  P(6  > 
0O)  =  0  or  P(0  <  6o)  =  0,  we  know  which  action  we  should  take  regardless  of  the  value  of  x. 
For  example,  if  P{0  <  0q)  =  0,  we  accept  H\  always.  So  both  two  cases  are  excluded  in  the 
testing  problem.  We  also  assume  fiG  =  /0°°  0dG(6)  <  oo  so  that  the  Bayes  analysis  can  be 

carried  out. 

Let  fG(x)  =  f  f(x\6)dG(Q)  be  the  marginal  pdf  of  X,  and  <f>G(x)  =  E[9\X  —  x]  be  the 
posterior  mean  of  6  given  X  =  x.  Note  that  <f>G(x)  is  increasing  and  <j>G(6 0)  <  0o.  Then  the 
Bayes  rule  stated  in  Section  1  can  be  represented  as 

SG(x)  =  1  if  4>g{x)  >0o^x>cg-,  5g(x)  =  0  if  4>c{x)  <d0<=>x<cG. 

where  cG  =  inf  (re  €  (90,  b)  :  <f>G(x)  >  60}.  cG  is  called  the  critical  point  corresponding  to  G. 

Since  the  Bayes  rule  SG  is  characterized  by  a  single  number  cG,  a  monotone  empirical 
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Bayes  test  (MEBT)  can  be  constructed  through  estimating  cG  by  Cn(X i,  X2,  •  •  • ,  Xn),  say, 

“  "  -  (2.1) 

if  X  <  Cn- 

R(G,  Sn)  -  R(G ,  SG)  =  E  r°  w(x)a(x)dx,  (2.2) 

Jon 

where  w(x)  =  ac(^)[^o  —  ^g(^)]  and  aG(x)  =  f(0xj  dG(6)/A{6). 

To  consider  the  rate  of  convergence  of  R(G,6n)  —  R(G,5g ),  we  assume  that  for  some 
r  >  1 ,  aG(x)  is  r-times  continuously  differentiable  and  for  i  =  0, 1,  •  •  • ,  r, 

sup  lag  (a;)  I  <  Br  <  00.  (2.3) 

e0/2<x<b 

Furthermore,  we  assume  that 

g(cG )  =  G'(cg)  ^  0.  ^  (2-4) 

From  (2.3),  we  know  that  <j)G(x)  is  continuous.  Then  ca  >  6 0  since  <f>G(0o)  <  0o.  Also,  from 
(2.3)  and  (2.4),  90  <  b  since  A(b~)  =  limxTb  A(x)  =  0. 


and  defining 


5n  =  { 


1 

0 


Then  the  regret  of  5n  is 


3.  An  upper  bound.  We  shall  construct  a  MEBT  and  find  an  upper  bound  of  its 
regret.  The  kernel  method  is  used  in  the  construction.  Let  Ko(y)  be  a  Borel-measurable, 
bounded  function  vanishing  outside  the  interval  [0, 1]  such  that 


f1  yjKo(y)dy  = 

JO 


1  if  j  =  0, 


(3.1) 


0  if  j  =  1,2,  •  •  •  ,r. 

Suppose  \K0(y)\  <  B.  Denote  Kjy)  =  /0y  K0(s)ds  and  un  =  n-1/<2r+1>.  For  any  a;  €  (0,6), 
define 


w  ,  ,  _  «.  -  X  A  KoiSti  _  i  V  Mjtl 
nun  §  a(Xj)  rift  a(X,)  ' 


(3.2) 
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It  is  shown  later  that  Wn(x)  is  a  consistent  estimator  of  w(x).  Since  P(d  <  d0)  >  0 
aG(x)  >  0  for  x  >  do-  Thus  cG  =  Se0  hw(.*)>°]dx  +  ^et 


Cn 


I[wn(x)>o]dx  +  60, 


(3-3) 


where 


dn  =  { 


(d0  +  Inn)  A  b  if  a(b-)  >  0, 

inf{x  >  60  ■  a(x)  <  un1/3}  A  (d0  +  Inn)  A  b  if  a(b-)  =  0. 

Then  we  propose  a  monotone  empirical  Bayes  test  5n(x)  by 


Sn  =  { 


1  if  X>Cn, 
0  if  X  <  Cn- 


Note  that  dn  — *  b.  As  dn>  cq, 

Cn.  —  cq  =  —  [  I[wn(x)<o}dx  +  f  I[wn(x)>o]dx. 
J6o  JcG 


(3.4) 


(3.5) 


Note  that  K  is  a  monotone  rule.  It  has  good  performance  for  small 'samples  (See  Van 
Houwelingen  (1976)).  Next  we  show  that  is  a  good  procedure  not  only  for  small  samples 
but  also  for  large  samples. 

Prom  (2.3),  w'(x)  is  continuous  and  w'(x)  =  g(x)(6o  —  x)/A(x).  Since  g(co)  0  and 
cG  >  d0,  w'(cG)  <  0.  Then  w'{x)  <  0  in  a  neighbourhood  of  cG.  For  e  >  0,  define 
Ae  =  min{— iy'(x)  :  x  €  [ cG-e,cG+e ]}.  Suppose  eG  >  0  such  that  60  <  cG-eG  <  cG+eG  <  b 
and  Aec  >  0.  Then  for  0  <  e  <  eG,  Ae  >  Aea  >  0. 


Lemma  3.1.  Let  a  and  w  be  the  supermum  values  of  a(x)  and  —w'{x)  on  [cG  eG,  cG+eG} 
respectively.  Then 

R(G,  6n)  -  R(G,  SG)  <  (do  +  P-G)cGAE(cn  -  cGf  +  1/2 dwE(cn  -  cGf.  (3.6) 
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Lemma  3.2.  Let  M  =  B2Cq{ 3  +  16i?r[a(cG)]2}.  Then 
(3.7.1)  \im  E(cn  —  cc)2  <  M/[a(cG)w'(cG)]2\  (3.7.2)  lim^n‘2r+1  E(cn  —  cG)  =0. 

The  proofs  of  Lemma  3.1  and  Lemma  3.2  are  given  in  Section  5.  Note  that,  as  eG  —>  0, 
aw  _>  a(cG)|u/(cG)|.  Therefore  the  previous  two  lemmas  give  the  following  theorem. 

Theorem  3.1.  Let  M  be  the  number  defined  in  Lemma  3.2.  Then 

lim  n&[R{G,8n)  -  R(G,6g )]  <  M/[2a(cG)|u/(cG)|].  (3.8) 

n — KDO 


To  consider  the  uniform  convergence  rate  of  Sn ,  we  define  a  class  of  prior  distributions. 
Denote 

Q  =  {G  :  G  satisfies  pG  <  po,  (2.3),  Co  <  cG  <  po,  a.JjT1*oj  lu,,(a;)l  —  ^}>  (3-9) 

where  po  <  oo,  6o  <  Co  <  Po  <  b,  Co  =  (co  +  $o)/2,  po  —  (2po)  A  ((po  +  ^)/2)  and  L  >  0. 
Assume  that  is  not  empty  in  the  following. 

Theorem  3.2.  For  some  l  >  0, 

sup[i?(G,  Sn)  —  R(G,  <5g)]  <  l  •  n  2r+1  (3.10) 

GeG 

4.  A  lower  bound.  We  shall  obtain  a  minimax  lower  bound  for  the  regrets  of  all 
monotone  empirical  Bayes  tests  first.  In  the  following  parts  of  this  paper,  l\ ,  l;2 ,  •  •  ■  stand 
for  the  positive  constants,  which  may  have  different  values  on  different  occasions. 

Let  C  be  the  set  of  all  estimators  c*  with  c*  >  0  and  let  V  be  the  set  of  all  empirical 
Bayes  rules  of  type  (2.1)  with  Cn  =  c*  £  C.  Let  T  =  {fG(x)  =  f  f(x\6)dG(9)  :  G  £  Q}  and 
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Cf  be  the  critical  points  corresponding  to  /  <E  F. 


Lemma  4.1. 


inf  sup[-R(G,  5*)  —  R(G,  5©)] 

KzV  GeQ 

>  li  sup  {(c/!  —  Cf2)2  :  j[\fh (®)  “  \f ■  f2(,x)]2dx  <  h/n,  /i,/2  £  -T7}- 


Suppose  that  G\<eG  with  density  g\{9)  and  cSl  <E  (co,  Po)-  Let  p2($)  —  (1+^nPn)  1bi(^)+ 
ur-1A(e)H(^)}I[e> o],  where  pn  =  fh  A(ch+tun)H(t)dt  and  tf(t)  is  a  function  such  that 
(1)  it  has  support  [-1,1],  (2)  =  0  and  &H{t)dt  ±  0,  and  (3)  it  has  bounded 

derivatives  upto  order  r.  Let  fi(x)  =  a(x)  f0  ^jdO  for  i  —  1, 2. 

Lemma  4.2.  As  n  is  large,  €  T , 

\ 

J [\Jfi(x)  -  JW)?d*  <  h/n  and  (c/i  ~  chf  -  l*n  2r+1- 


Theorem  4.1.  For  some  l  >  0, 

inf  sup  [R(G,  5*)  -  R(G,  fc)]  >l-rC&. 

Gee 

Theorem  4.1  says  that  rT^1  is  the  best  possible  rate  of  convergence.  With  the  result  in 
(3.10),  we  conclude  that  n-2^1  is  the  optimal  rate  of  monotone  empirical  Bayes  tests  and  5n 
defined  by  (3.4)  achieves  this  rate.  So  Sn  has  good  performance  not  only  for  small  samples 
but  also  for  large  samples. 

5.  Proofs. 
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5.1.  Proof  of  Lemma  3.1.  From  (2.2), 

R{G,  5n)  -  R(G ,  5g )  <  E[I{{Cn.CG]>ea]  H  w(x)a(x)dx]  +  dE[I[]Cn-ca \<ea]  f  w(x)a(x)dx] 

JCn  Jcn 

fC  (6q  4“  —  C G )  l/2awE(Cn  Cg)  , 


where  /CCG  w(x)a(x)dx  <  (0O  +  fiG)  and  by  Taylor  expansion 

I]\cn- cgI<£g]  [  w(x)dx  —  1/2  x  W  (cn)(cn  —  CG)  I[\cn— cg|<«g]  —  l/2^(Cn  —  CG)  . 

5.2.  Proof  of  Lemma  3.2.  Recall  Ae  >  0  for  e  <  eG.  For  e  <  eG,  Let  rji  =  cG  —  e  and 
t/2  —  cG  -t~  e.  Rewrite  Wn{x)  =  ±  E”=i  V^X,-,®),  where 

x)  *.(^) 

«.  o(X,)  o(Xj)  ' 

Note  that  Vn(Xj,x)  are  i.i.d.  with  for  fixed  x  and  n.  Let  wn(x )  =  E[Vn(Xj,x)],  Zjn  = 
x)-wn(x),  ol  =  FZ?n  and  ln  =  jB[|Zin|3].  Denote pn  =  min{a(x)  :  x  €  far  ~un, t?2]}. 
Then  we  have  the  following  lemma.  Its  proof  is  given  in  the  subsection  5.5. 


Lemma  5.1.  The  following  statements  hold  for  large  n. 

(i)  For  x  G  [0O,  ?7i)  U  (772, 6),  |w(x)|  >  eAe  as  e  <  eG; 

For  x  G  [0O, dn],  \w{x)\  <  (20o  +  In n)Br. 

(ii)  For  all  x  G  [0o,d„],  \wn(x)  -  w(x)\  <  BrBurnx  =  1/2 \/3(x). 

(iii)  For  x  G  fai.ife],  <7*  <  m{pnun)~l,  m  =  fa  -  0o  +  un)2B2Br; 

For  x  G  [0O,  d«],  <  i2(ln n)2u„-4/3. 

(iv)  For  x  G  [771,772],  In  <  h(pnUn)~ 2;  For  x  G  [0o,dn],  7n  <  /4(lnr*.)3un8/3. 

(v)  For  x  G  [0o,d„],  to(x)  >  /3(x)  =>  u>„(x)  >  l/2to(x). 

(vi)  For  x  G  [0O, d„],  w(x)  <  -/?(x)  =*■  ton(x)  <  l/2t v(x). 

Since  cG  <  b ,  assume  that  cG  <  dn  for  all  n  without  loss  of  generality.  Based  on  (3.5),  we 
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decompose  Cn  —  cq  as  follows: 


Cn  —  cg  =  —I\  —  h  —  h  +  h  +  h  +  h, 


(5.1) 


where 

I\  =  f—0o  I[Wn(x)<0]dX,  d2  fi]2  I[Wn(x)>0]dx, 

h  =  X,T  I{wn(x)<oMx)<P(m)}dxi  J4  =  IpVn(x)>oM*)>-0(i ^dx’ 

h  =  JJf  =  hwn(x)>oMx)<-P(m)}dx- 

Note  that  E(Cn  -  cGf  <  2 {E[dnh  +  if  +  %  +  +  l\  +  £]}•  To  prove  (3.7.1),  we  want 


to  show  that 


(5.2.1) 


lim  lim  E[dnI\  +  I3  +  di]  ^ 


M 

4  [a(cG)w'(cG)]2  ’ 


and 

M 

<5-2-2)  'is  Jsa. +  4  +  ^  -  IKcaMco)]2 ' 

We  only  prove  (5.2.2).  The  proof  for  (5.2.1)  is  similar.  For  w{x)  <K  ~P(x),  wn(x)  < 
l/2w(x)  <  0  from  (vi)  of  Lemma  5.1.  Then  we  have 


.  1  "  .  r,  1  .  -y/nw(x) 

>  0)  =  P(-—  E  ^  > - — - )  <  P(j=i  E  ^  >  2crn  }‘ 

y/na*  3= 1  Un  \Jnan  J= 1 

Applying  Theorem  5.16  on  page  168  in  Petrov  (1995)  to  the  left-hand-side  of  the  above 


inequality,  P(W.(x)  >  0)  <  [1  -  4(^)1  +  s  S^x)  +  T"{x)’  ^ 

A  is  a  constant  and  'I'M  is  the  cdf  of  N( 0,1).  For  x  €  [572, d„],  w(x)  <  —tA€.  Then 
w{x)  <  -ijix)  as  n  is  large  since  urndn  —*  0.  Then  P(Wn{x)  >  0)  <  S„(x)  +  T„(x).  Note 
that  al  <  k(\nnfu~lP  and  7„  <  (tOnrt)3^3.  Then  S„(z)  <  1  -4>(»,/4)  and  T„(x)  <  n"1 
as  n  is  large.  Thus 


dnE[h\  =  dn  P(Wn{x)  >  0 )dx  <  d2n[  1  -  $(n1/4)  +  n  *]  =  o{n  2r/(2r+1))-  (5.3) 

Jm 


For  x  G  [cg, 772)1  K(x)|  >  Ae. 


Then  I\  <  A?\J™  (x)dx)2  <  AflPfa)}2  by 
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letting  y  =  w(x)/P(t]2).  Therefore 


lim  lim  <  [2BtBcg/w'(cg)]2- 

e-+0  n—+oo 


(5.4) 


By  Holder  inequality, 


pX]  2  7**72  rt 

£[/f]  <  /  ^(Wn(x)  >  0)|w(a:)|3/(u,(x)<-/3(^)]drr  x  /  |w(ar)|_ 

Similar  to  /?,  /£  Kx)|-3/Kx)>_pfe)]da;  <  1/{2A£[/3(t72)]2}.  Since  «;(*)  <  -/?(%)  <  -/?(«) 
for  all  x  G  [cg,%])  P(Wn(x)  >  0)  <  +  Tn(x)  and 

*Xj  2  /*^?2 

<  1/{2A€[j0(772)]2}  -  [ /  Sn(z)Hz)|3cte+  /  Tn(z)Kx)|3cte].  (5.5) 

«/C(5  ''CG 


For  x  G  [cG,m],  <  m(pnun)-\  7„  <  h(pnun)  2-  Therefore 

£  -  5  Ol  ~  *<^^)1Wl)|V(l)<iI  <  (5-6) 


and 


[m  Tn(x)|u;(a:)|3dx  <  8 Alze/(n2ulp2n). 
Jcq 


(5.7) 


Combining  (5.5),  (5.6)  and  (5.7),  we  have 


lim  lim  n2r+1F?[/|]  <  3H2Cg/[2a(cG)^,(cG)]2,  (5.8) 

€_>.0ti— +oo 

Then  (5.2.2)  follows  (5.3),  (5.4)  and  (5.8).  Thus  (3.7.1)  is  proved.  (3.7.2)  can  be  proved 
similarly  The  details  are  omitted  here.  Now  we  complete  the  proof  of  Lemma  3.2. 

5.3.  Proof  of  Lemma  4.1.  Denote  C  =  {cn  =  c*  V  Cq  A  po  :  c*  G  C}.  For  c*  G  C, 
cre  =  <Vc0Ap0GC  Define  a  =  (a(x)  :  x  G  [co,  po]}-  Then  a  >  0  and 

f  w(x)a(x)dx>  [  w(x)a(x)dx  >  a  f  w(x)dx  =  ——w' (c„)(cn  —  Cg)2 , 

Ac*  Ac„ 

where  cn  is  an  intermediate  value  between  cn  and  cq.  Clearly,  c„  G  [co,po]-  Therefore 
|,u/(cn)|  >  L.  Then  /CT  w(x)a(x)dx  >  li(Cn  —  cq)2  and 

inf  supM  f  w(x)a(x)dx]  >  h  in^supii^Cn  —  cq)2  ■ 
c*  eC  q€q  Ac*  Cn€CG€G 
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Note  that  CcC.  Using  (2.2) 


inf  sup  [R(G,5*n)-R(G,5G)]>h  inf f  sup£(c„  -  cG)2  >  h  inf  supE(c*n  -  cG)2. 

$*€£>  GeQ  ZntCGeQ  cnec  Geo 

Prom  the  results  in  Donoho  and  Liu  (1991)  (Theorem  3.1  and  the  remark  after  Lemma  3.3), 

inf  sup  E(c*n  -  cG)2  >  h  sup  {(ch  -  ch)2  :  / [yjfi(x)  ~  \J  h{x)]2dx  <  l2/n ,  /i,  h  e  ?}■ 
<ec  aeQ  J 

Then  Lemma  4.1  is  proved. 


5.4.  Proof  of  Lemma  4.2.  Clearly,  as  n  is  large,  Cq  <  cfl  -  un  <  ch  +  un  <  p0, 
g2(0)  >  0  and  ch  G  (co,  p0)-  Then  f2  €  T.  Note  that  f0x  H((6  -  ch)/u-l)d6  =  0  for  x  <  Co 
or  x  >  po,  and  fi(x)  =  0  =>-  x  <  60  =>  h{x)  —  0-  Also  f°r  ^  e  G,  Jo°  dG(6)/A(9)  >  0. 
Then 


{JK&)-s/Mx)}2  <  IlMx)>o][fi(x)-h(x)}2/Mx) 

S  /;  + w>- 

Note  that  pn  =  S-i  -^(c/i  +  tun)H(t)dt  =  0(un )  and 

f°  a(x)[  f  H(^^-)d6]2dx  <  hu3n  t  a{ch  +  yu„)[ F  H(t)dt]2dy  =  0(u3n). 

JO  Jco  Un  J- 1  ■/_1 


Then  we  have 


Hyfm  -  \fhix)]2dx  <  h[0(v%+1)  +  0(ulr+ 2)]  <  fe/n. 

J  0 

On  the  other  hand,  we  have  [w2(cf J]2  =  [u!2(c/2)  -  ^2(0/, )] 2  =  [w2 (cfi)]2(ch  _  c/i)2>  where 
c/i  is  an  intermediate  value  between  cfl  and  C/2.  It  is  easy  to  see  that  [w'2(cfl)}2  <  l/l\. 
Then  (ch  -  ch)2  >  h[w2(cfl)]2.  Note  that 

[w2(cfl)]2  >  ku2r2[  [Ch (do  ~  e)H(6^^)def  >  l2u2:[  f  (6 0  -  ch  +  tun)H(t)dt}2 

JO  ^ n  J  1 

and  H(t)dt  ±  0.  Therefore  (ch  -  ch)2  >  lzn~^.  The  proof  of  Lemma  4.2  is  complete 


now. 
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5.5.  Proof  of  Lemma  5.1.  Noting  that  w(x)  is  decreasing  on  (0O,  b)  and  w(cG)  =  0, 
|w(x)|  >  | w(cG  -  e)|  A  | w(cG  +  e)|  for  x  €  {60,%)  U  (%,&)•  Since  w'(x)  >  Ae  for  rc  € 

\w(cG  -  e)|  >  Aee  and  \w(cG  +  e)|  >  Aee.  Then  K*)|  >  Aee.  On  the  other  hand,  since 
^(x)  <  x  and  ao(x)  <  \w(x)\  <  (2d°  +  In n)Br  for  x  <E  [90,dn).  Then  (i)  is  obtained. 

With  loss  of  generality,  assume  that  un  <  60/2  for  all  n.  It  is  easy  to  verify  that  w(x)  = 
(e0  -  x)aG(x)  +  fo  aG(s)ds.  A  straight  forward  computation  shows  that  for  x  6  [0Oldn], 

| E[Vn(Xjt  x)]  -  iu(x)\  <  uTn(x  -6o+  un)BrB.  Then  (ii)  is  proved.  Note  that 

al  <  E\y(XJtx,n)]2  =  jf*  0  ~  X)K°®  ~  unK^)?ao(x  ~ «"*)*• 

Therefore  al  <  m(pnun)~1  for  x  e  [onW]  and  o\  <  k{lnn)2u~i/3  for  x  <E  [60,dn].  The 
results  for  7n  can  be  proved  similarly.  This  completes  the  proofs  of  (iii)  and  (iv). 

For  x  €  [0o,  dn] ,  if  w(x)  >  P{x), 

wn(x)  _  w(x)  +  KW  ~  w(x)]  ^  w(x)  —  /?(%)  +  l/2/3(x)  ^  1 
^J(x)  =  w(x)  ~  w{x)  -  P(x)  +  P(x)  ~  2' 

Then  (v)  is  proved,  (vi)  can  be  proved  in  a  similar  way. 
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